DISTORTED HANKEL INTEGRAL OPERATORS 



A.B. ALEKSANDROV AND V.V. PELLER 



Abstract. For a,P > and for a locally integrable function (or, more gener- 
ally, a distribution) ip on (0, oo), we study integral ooperators iS^''' on L^(K+) 
defined by [&'^'^f){x) = f^^ ip^x" + y^)f{y)dy. We describe the bounded and 

compact operators and operators (S^'*^ of Schatten-von Neumann class Sp. 
We also study continuity properties of the averaging projection Qa.fi onto the 
operators of the form 25^'''. In particular, we show that if a < /3 and /3 > 1, 
then is bounded on Sp if and only if 2/3(/3 + l)-^ <p< 2/3(/3 - l)'^. 

1. Introduction 



We are going to study a class of integral operators on L^(M+) that generalizes 
Hankel integral operators. 

For a function ip in L^(M+), the integral Hankel operator is defined on L^(M+) 

by 



{rj){x)= [ ipix + y)f{y)dy. 



It is easy to see that such operators are bounded on L (M+). Operators can be 
bounded in a much more general case. For to be bounded, ip does not have to 
be a function, it can be a distribution. Bounded Hankel operators -T^ are unitarily 
equivalent to Hankel operators on i"^, i.e., operators with Hankel matrices of the 
form {(^j+k}j,k>o- These facts can be found in ||Pel4|| , Ch. 1, 



In this paper for a, P > 0, we study the integral operators C5^'^ on L^(M+) 
defined by 

((!5°'^/)(x)= / p{x" + y^)f{y)dy. (1.1) 

Clearly, if is a locally integrable function on = (0, oo), the right-hand side of 
(|1.1| ) is well defined for smooth functions / with compact support in (0, oo). The 
integral on the right-hand side of ( |1.1D makes sense for distributions (p on (0, oo) and 
infinitely differentiable functions p with compact support in M+. We say that for a 
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distribution yj, the operator (S^'^ is bounded on L^(R+) if it extends by continuity 
to L^(M_|_). Integral operators 0^'^ are called distorted Hankel operators. We are 
going to study boundedness, compactness and Schatten-von Neumann properties 
of distorted Hankel operators. 

Obviously, for a = (3 = 1, the operator ^5^"'^ coincides with the integral Hankel 
operator F^. On the other hand, the limit case of the operators 0^'° as a ^ oo 
are the integral operators on L^(M+) defined by 



We refer the reader to ||AJPR|| where the operators Q^p are studied in detail. Note, 
however, that properties of the operators Q^p are quite different from properties of 
the operators 6°'^. 

In §2 we collect necessary information on Schatten-von Neumann classes, 
weighted integral Hankel operators, and discuss properties of the averaging pro- 
jection and weighted projections onto the integral Hankel operators. We state in 
§2 known results (Theorems A-D) that will be used in Sections 4 and 5. 

In §3 we show that Theorem B, that describes the weighted integral Hankel 
operators P^'^ of class Sp, does not extend to a and (3 not satisfying the hypotheses 
of Theorem B. 

In §4 we reduce the study of the operators 0°'^ to the study of weighted integral 
Hankel operators (see the definition in §2). We describe the operators S5^'^ that 
belong to the Schatten-von Neumann class Sp under a certain condition on a, 
and v. 

In §5 we introduce the averaging projection Qa,p onto the subspace of operators 
of the form (S^''^ and we study their metric properties. In particular, we show that 
if a < /3, /3 > 1, and 

< p < 



(3 + 1 ' (3-r 

then Qa,(3 is bounded on Sp. Moreover, this result is sharp. It is interesting to 
observe that both and go to 2 as /3 tends to oo. However, in the limiting 
case the averaging projection on the subspace of the operators of the from is 
bounded for all p G (1, oo), see [|AJPR| . 



It is also interesting that, unlike in the case of Hankel integral operators, for 
a, /5 G (0, 1), the averaging projection Qa,i3 is bounded on Si, and on the space of 
bounded and compact operators. 
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2. Preliminaries 



Schatten— von Neumann classes. Recall that for a bounded operator T on 
a Hilbert space Ti the singular values Sj(T), j > 0, are defined by 

Sj{T) = inf{||T -K\\: K e BiU), rankisT < j}. 

Here B{7i) denotes the space of bounded linear operators on Ti. 

The Schatten-von Neumann class Sp = Sp(H), < p < oo, consists of the 
operators T onH such that 




We denote by C(H) the space of compact operators on H. 

li 1 < p < oo, then || ■ ||s is a norm, which makes Sp a Banach space. For 
p < 1, II ■ \\sp does not satisfy the triangle inequality, it is a quasinorm (i.e., 
\\Ti + T2\\sp < const(||Ti||sp + ||T2||sp) for Ti, T2 G Sp), which makes Sp a quasi- 
Banach space. 

The linear functional trace is defined on Si by 

trace T = ^^(Tcj, Cj), T & Si, 

where {ej}j>o is an orthonormal basis in Ti. Moreover, the right-hand side does 
not depend on the choice of the basis. 

If 1 < p < 00, the dual space S* can be identified with Spi with respect to the 
pairing 

{T,R) = trace Ti?*, T e Sp, Re Sp>. (2.1) 

Here p' = p/{p — 1) is the dual exponent. With respect to the same pairing ( p.l|) 
one can identify SI with B(H) and (C(7i)) with Si. 

In the case Ti = L'^{X,fi) and /i is a cr-finite measure, the space ^2 coincides 
with the set of integral operators 3k, 

{3kf)ix)= [ kix,y)fiy)dfi{y), feL\X,^i), x,yeX, 
J X 

with k e L'^{X X X , jj, ® jj,) and 




Moreover, if T and R are integral operators in ^2 with kernel functions k and ^, 
then 



trace TR* 



k{x,y)^{x,y)diJ,{x) d^iy). 



Xy.X 



We refer the reader to ||GK]| and ||BS|| for basic facts about Schatten-von Neumann 
classes. 



Besov classes. We consider here spaces 03^ of distributions on M+ = (0, cxd). 
The space 03* can be identified with the restrictions of the Fourier transforms of 
functions in the Besov classes -Bp(M) to R+. 

Let f be a function on R such that 



supp V 



1 



oo 

and ^ V = 1, a; > 0. 



Put 



^A^) = V ( J-) 



X > 0. 



(2.2) 



For < p < oo and s G M, we define the space 05^ as the space of distributions 
ip on R_|_ such that 

/ oo \ Vp 



and 



def 



IV^II^s^ = sup 2^''\\J='{vjip)\\L'^ < oo. 

— oo<j<oo 

Here J-' denotes the Fourier transform. 

If p > 1, is a Banach space with norm || ■ ||*b^. If p < 1, 55* is a quasi-Banach 

space with quasinorm || ■ ||*b^, i.e., ||v9i + ip2\\<s^p < const (||v5i||<b^ + ||v52||'8j)- 

We also define the space b^, s G R, as the closed subspace of 05^, which consists 
of distributions ip G 03^ such that 

lim 2^'\\J^{vjip)\\L^ = 0. 

I J Hoc 

If V9 is a distribution on R+ and ipi^x) = x"ip{x) (this equality has to be under- 
stood in the distributional sense), then it is easy to see that ip G 53^ if and only 

ifVe^^-. 

If 1 < p < oo and si, S2 G R, one can identify the dual space i^^p) with the 



space QSp? with respect to the pairing 



(2.3) 



Note that the integral on the right-hand side makes sense for compactly supported 
C°° functions ip can be understood as the value of the distribution ip at the function 
t 1-^ t^'^^^^(p{t). The linear functional ip ^— (fjip) extends by continuity to the 
whole space 05*^ As usual, ^ + ^ = 1. 

The dual space can be identified with the space QS^^ with respect to the same 
pairing (|2.3|) . 

Remark. The Besov spaces -Bp(M) of functions on M can be defined as the space 
of tempered distributions / on M such that 

oo oo 

E (2^^II/*0IU.)"+ [r^f* vMl^Y <oo, 

j=—oo j=—oo 

where and rjj are functions in on R such that 

jF^j = Vj and {J^rjj){x) = Vj{—x), x G M. 

and the vj are defined by (|2.2|) . This this space contains all polynomials. It 
is possible to define the space -Bp(M) modulo the polynomials of degree at most 
s — 1/p, in which case only polynomials of degree at most s — 1/p can belong to 
this space. In both cases 

^;={^/|(0,oo): feB;{R)}. 

The subspace (fip(M))^ of fi^(M) is defined by 

{B;{R))^ = {fe B;iR) : supp^/ C [0,+oo)}. 

Functions in {B^{R)) ^ can be extended analytically in a natural way to the upper 
half-plane. Clearly, 

{(^/)|(o,oo): f e {b;{r)) ^} = <b;. 

We refer the reader to ||Pee|| for more information about Besov classes. 

Weighted integral Hankel operators. For a locally integrable function ip on 
M+ the weighted integral Hankel operator -T"'^ is defined by 

POO 

{r'^/f)ix)= / x''y^pix + y)fiy)dy 



for smooth functions / with compact support in M+. Again, the definition makes 



sense for distributions (p on M+. The operators -T"'^ are analogs of weighted Hankel 



matrices F^'^ = {(1 + + ^Yi^ii + ^)}jfe>o' where ip is a, function analytic in 
the unit disk. 

For a = /5 = 0, the operator 1^°'° = is the integral Hankel operator defined 
in the introduction. 



We need the following results. 



Theorem A. Suppose that a > and f3 > 0. Then -T"'^ is bounded on 
if and only if ^ E and -T"'^ is compact if and only if ^ E ^Sd"^- 



We refer the reader to [|Pel2|| for the corresponding result for weighted Hankel 
matrices and to ||J P|| for more general results than Theorem A. 



Theorem B. Let < p < oo. Suppose that min{a,/3} > max{ — i, — Then 
r°'^ G 5p if and only if ^ e 23^^+°+^. 

For p > 1 the description of the weighted Hankel matrices F"'^ of class 



m 



lPiT2| 



in the 



case 



Sp was obtained in |[Pell|] for a = /5 = and 
min{a,/3} > max{ — i, — i}. For integral Hankel operators and p >1 see ||CR|| , 



10, and [ [TF] ]. In the case p < 1 we refer the reader to [ |Fell| ] for weighted Hankel 
matrices and to fSl for the weighted integral Hankel operators. See also [|Pel4 
Ch. 6. 



Averaging projection onto the integral Hankel operators. Consider the 
orthogonal projection V on the Hilbert-Schmidt class S2 onto the subspace of 



Hankel integral operators. Clearly, ii k E L 



then 



where 



k{t, X — t)dt. 



For 2 < p < 00, the averaging projection V can be defined on the dense subset 
n ^2 of of Sp. As usual, we say that V is bounded on Sp if it extends by 
continuity to a bounded operator on Sp. 

Theorem C. Let 1 < p < 00. Then the averaging projection V is hounded on 
Sp. 

The same result for the averaging projection onto the space of Hankel matrices 
was obtained in |[Pell|| , see also ||Pel4|| . The same proof works for the averaging 
projection onto the set of integral Hankel operators. 

Note that V is unbounded on Si and on the spaces of bounded and compact 
operators (see [ [Pell|| , |[Pel4|| ). However, there are bounded projections on Si onto 
the subspace of integral Hankel operators. Indeed, for a, /? > we define the 
weighted averaging projection Va,i3 by 



where 



J r(x -tyk{t,x -t)dt 


X 





Theorem D. Let a, f3 > 0. Then Va,i3 is a bounded operator on Si. 

The corresponding resuh for weighted averaging projection on the subspace of 
Hankel matrices was found by the first author, see ( [[Pel2|| and ||Pel4|] ) . The same 
proof works in the case of integral operators. 



3. Theorem B is sharp 

When we study properties of the averaging projection Qo,/3 onto the space of 
operators of the form ^5"''^, we will need the fact that Theorem B cannot be 
extended to other values of a and p. 



Theorem 3.1. Let a, /5 G M and < p < oo. Suppose that min{a,/5} < 
ax{ — |, — Then there are functions ip G ^l^^^"^^ such that -T^'^ ^ Sp. 



Proof. Consider first the case p > 2. For a positive integer n we define the 
function ipn on M+ by 



1' + 

0, otherwise. 



It follows easily from the definition of ^^^"^""^^ that 

IIV^n||rRVp+Q+;3 < COUSt ||J?^V^„||lp < COUSt -fl"^^^' . 

Let us now estimate from below ||-r"'^||„ . Define the function k on Mi by 




where 



'J' 

def J k=0 

n 

k=0 



^ n n J \ n n 
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Since the squares have disjoint projections onto the coordinate axes, it is easy 
to see that 

\i=o 

where kj — kxAj and xaj is the characteristic function of Aj. Clearly, 3kj is a 
rank one operator and 

Without loss of generality, we may assume a < (3. It is easy to verify that 

i/p 



> const 

Clearly, 



n " ^, a < — 

n-"-i(log(l + n)flP, a = -1/p. 



II r'°="'^|| 

II WSp 

</^n||(gi/p+«+/3 



oo as n 



which completes the proof in the case p>2. 

Suppose now that p < 2. Again, we assume that a < (3. We prove that if 
q; < — |, the condition il) e 03^^^"^^ does not even imply that F'^^ G 82- Let 
■j/) be a nonzero smooth function with support in [1,2]. Clearly, Til^ G LP, and so 
^ e 03^^'+"+''. On the other hand. 



I r'"''3|l^ 

I-* V- IIS2 



since, clearly, 

'0 



^0 



4. Boundedness, Compactness, and Schatten— von Neumann Properties 



Let A; be a function on such that the integral operator on L^(R+) with kernel 
function k is bounded on L^(R+). As in §2, denote this integral operator by '3k'- 

{^kf){x) = / k{x,y)f{y)dy. 




We say that k G S'p(M^) if the operator 3^ belongs to the Schatten-von Neumann 

class Sp 
We put 



class Sp and we write == |pfc||sp. Let now a and (3 be nonzero real numbers 



kaA^^y) = ^^''^ 2?/i lk(x'^,y0). (4.1) 



We introduce the unitary operator f/^ on L^(M+) defined by 

\/\a\ ^ ^ 

It is easy to see that 



and so 

\KAs^ = \\k\\s^- 

Theorem 4.1. Suppose that a, (3 & (0, 1). Then 0^'^ is bounded if and only if 

1 —+- 1 

ip G 53^ ^'^ . The operator C5"'^ is compact if and only if ^ E ^'^ 

Proof. Suppose first that is a locally integrable functin on IR+. Consider the 
kernel function x of S'"''^: 

x(x, y) = + X, y> 0. 

Obviously, by 

= + (4.2) 

i.e., the integral operator operator with kernel function x^,^^ is a weighted integral 

_i 1 J 1 

Hankel operator. Hence, C5^'^ is bounded (or compact) if and only if F^" ^'^'^ ^ 
is bounded (or compact). By Theorem A (see §2), this is equivalent to the fact 

that if G Qsi"^^"' (or if G b^^^~ 

If is a distribution, it is easy to verify that the formula 

rp~^'^~'^ = ^u^f^m (4.3) 



still holds, which implies the result. ■ 

Theorem 4.2. Let p, a, and (3 he positive numbers such that 

max{a, (3}{p — 2) <p. 

Then 0^'^ G Sp if and only if if e 
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Proof. Again, apply formula ( |4.3| ). Obviously, a and (3 satisfy the hypotheses 
of Theorem B. The result follows from Theorem B. ■ 

It turns out that in the case 1 < p < oo the necessity of the condition 

(f e QSp" ^'^ holds for any positive a and [3. 



Theorem 4.3. Let I < p < oo, and let a and (3 he positive numbers. Suppose 
that e 5p. Then ^ G <b|^^^^^"\ 

Proof. As we have already observed, the integral operator ^ with kernel 
function Ka^p defined by (^I^ ) must belong to Sp. 

Suppose first that p > \. We apply to 3^^ ^ the averaging projection V (see §2). 
It is easy to verify that 

^^><a,,3 = const r^, 

where 

i){x) = x^^'^~^(p{x). (4.4) 
By Theorem C, G Sp. Now by Theorem B, G ^y^, which is equivalent to 

— + — + 

the fact that cp G QSp" " (see Section 2). 

Let now p — 1. We apply to the operator ^3^^^ the weighted projection T^i.i, 
which is bounded on Si (see Theorem D). It is easy to verify that 

Via3^^ ^ = const r^, 

where ip is defined by ( |4.4] ). By Theorem B, G 03 J, which is equivalent to the 

fact that cp G QSf (see §2). ■ 



5. The Averaging Projection onto the Operators 

In this section we study metric properties of the averaging projection on the class 
of operators of the form C5^'^. Consider the orthogonal projection Qa,i3 from the 
Hilbert-Schmidt class ^2 onto the subspace of S2 of operators of the form 0^'^. 
Clearly, Qi i is just the averaging projection V onto the Hankel integral operators. 
If we identify the Hilbert-Schmidt operators on L^(R+) with the space L^(R^), 
we find that Qa,i3 is the orthogonal projection onto the subspace of functions that 
are constant on the sets [{x, y) G : + = c}, c > 0. 

We are going to characterize those a, /3, and p, for which the projection Qa,i3 is 
bounded on Sp. Clearly, Qa,i3T is well-defined for T E Sp if p < 2. If p > 2, we 
say that is bounded on Sp if it extends to a bounded operator from Sp fl S'2. 
Since is self-adjoint on S2, it follows that Qa,/3 is bounded on Sp if and only 
if it is bounded on Sp>, 1 < p < 00, and Qq,/3 is bounded on Si if and only if it is 
bounded on B{L'^(R+)). 
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Lemma 5.1. Let k e L^(]R^) and let a, P > 0. Put 



k[xa COS" t,xi^ smi^ tj cos<^ t sin's 



where 



2 



Then 

Q^,p3k = (5.2) 
Proof. The result follows from the following easily verifiable formula: 

7r 

OO 2 

J J f{x,y)dxdy = —^ J r'^^'i^^^ J f (r~ cos" t,r'P sin'^ t) cos'^~^ tsin'^~^ t dt dr, 

r2_ 

(5.3) 

which holds for any nonnegative measurable function /. ■ 

Remark. Note that A{a, P) = ^B{l/a, 1/(3), where B is the Euler Beta func- 
tion. 

Theorem 5.2. Let 1 < p < oo, and let a and (3 he positive numbers. Suppose 
that 

— p < max{a, /9}(p — 2) < j9. (5.4) 
Then Qa,i3 is hounded on Sp. 



Note that if max{a,/3} < 1, the rightmost inequality in ( |5.4| ) holds for any p. If 
max{a,/3} > 1, then ( ^.4|) is equivalent to the inequahties 

2maxia,/9} 2max|a,/3| 

< P < L ^^-J 



max{a,(3} + l max{a,/5} — 1 

Clearly, ^^^^f^i and ^^^pf}i are dual exponents, i.e., the sum of their recip- 
rocals is euqal to one. 

Proof. Consider first the case p > 1. Let 7^^/? be the operator on Sp defined by 

r„,^T = ^, where Qa,pT = 0°'^ 



see Lemma By Theorem [4.2| , we have to show that Ta^p is a bounded operator 



from 5p to ^bI"*" \ 
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Consider the dual exponent p' = p/{p — !)• Define the operator 

by 

(7^<^)(a;, y) = ^{x'' + /), y > 0. (5.5) 

By Theorem ^l2| , 7^ is a bounded operator. 
Let k e SiiRl) and let 

(see (O) and (OI)). We have 



jj{n(p){x,y)k{x,y)dxdy = JJ{nLp){x,y)ip{x'' + y'^)dxdy 



2A(a,p) 

a/3 



(p(r)^lj(r)dr. (5.6) 



It follows that r„,/3 = n* if we identify (^?B;, ) with with 

respect to the pairing 



-1 



if, 9)= / t^'-^^'f{r)g{r)dr (5.7) 

(see §2). Hence, 7^^^ is a bounded. 

Suppose now that p = 1. Clearly, ( |^ ) means that < a, P < 1. Consider the 
operator 

7^: b^^^'' ^ C{L\R+)) 
defined by (|5.5|) . It is bounded by Theorem A. Again, it is easy to see from ( |5.6|) 



that T„*^ = 7^ if we identify (^b^^^" j with ^B^"^^^ with respect to the pairing 

m- ■ 

Now suppose that a, /? G (0, 1). By Theorem |5l^ , the averaging projection Q^^j 
is bounded on Si. We can consider the conjugate operator Q*^ on the space 
;B(L^(M+)) with respect to the standard pairing between Si and i3(L^(M+)) (see 
§2). Since Qa,i3 is a self-adjoint operator on ^2, it follows that Q^ /^T = Qa,pT for 
T G ■S'2. We can now extend the averaging projection Qa,p to the space i3(L^(R+)) 
by 

Qa,/3T= q;^t, TgS(L^(M+)). 

It is easy to show that if T is a bounded integral operator on L^(]R_|_) with kernel 
function k, then Qa,i3T can be defined as in {f).l\) and ( ^.2|) . 
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Theorem 5.3. Let a, P E (0, 1). Then Qa,i3 is a hounded operator on the space 
i3(L^(M4.)) of hounded operators and on the space C(L^(]R+)) of compact operators. 

Proof. We have aheady explained the fact that Qa,p is bounded on i3(L^(]R+)). 
The boundedness of Qa,i3 on ^'(-^^(1^+)) follows immediately from the fact that 
Qa,0S2 C S2 and the fact that S2 is dense in C(L^(]R+)). ■ 



Let us prove now that Theorems |5.2| and ^.31 are sharp. 



Theorem 5.4. Suppose that a and (3 are positive numhers such that the av- 



eraging projection Qa,i3 is hounded on Sp, < p < 00. Then p > 1 and ( \5.4\) 
holds. 

Theorem 5.5. Suppose that a and j3 are positive numhers such that the averag- 
ing projection Qa,i3 is hounded on the space ;B(L^(R_|_)) or on the space C(L^(M+)). 
then a, (3 < 1. 

In fact for p < 1 the following much stronger retsult holds. 

Theorem 5.6. Let < p < 1 and a, (3 > 0. Then there is no hounded projection 
from Sp onto the suhspace of operators of the form 0^'^. 

Let us first prove Theorem |5.6| . 

Proof of Theorem |5.6| . The result follows from Theorem |4.2| and the Kalton 
theorem ||K|, which says, in particular, that if X is a coplemented subspace of Sp, 
< p < 1, such that X can be imbedded isomorphically to an space, then 
the Sp quasinorm and the Si norm on X are equivalent. Indeed, let X be the 
subspace of Sp of operators of the form C5^'^. By Theorem |4.2| , the Si norm and 
the Sp quasinorm on X are not equivalent. It follows easily from the definition of 
the spaces given in §2 that X can be imbedded isometrically in an space. 
Thus by the Kalton theorem X is not a complemented subspace of Sp. ■ 

Proof of Theorem |5.4| . Suppose that 1 < p < 00. The reasoning given in the 
proof of Theorem ^ shows that if the averaging projection Qa,i3 is bounded on 



Sp, then the condition (p e <Bp" " implies 0"'^ G Sp. The result now follows 



from ([4.2|) and from Theorem ^A. 



Proof of Theorem |5^. If is bounded on B{L^{R+)) or on C{L^{R+)), 
then, by duality, Qa fs is bounded on Si. The result follows now from Theorem 
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